Patronus AI co-founders Anand Kannappan and Rebecca Qian Patronus AILarge language models, similar to the one at the heart of ChatGPT, frequently fail to answer questions derived from Securities and Exchange Commission filings, researchers from a startup called Patronus AI found. "That type of performance rate is just absolutely unacceptable," Patronus AI co-founder Anand Kannappan said. It feels like just testing by inspection," Patronus AI co-founder Rebecca Qian said. Here's some examples of questions in the dataset, provided by Patronus AI: Has CVS Health paid dividends to common shareholders in Q2 of FY2022? How the AI models did on the test

---

Persons: Anand Kannappan, Rebecca Qian Patronus, OpenAI's, ChatGPT, they're, Rebecca Qian, FinanceBench, Qian Organizations: Securities, Exchange, CNBC, SEC, Bloomberg, JPMorgan, McKinsey, Microsoft, Facebook, Meta, Lightspeed Venture Partners, Patronus, CVS, AMD, Coca